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The inventioa relates to a motion sequence pattern detector for detecting 
presence of film material in a series of consecutive video fields. 

The invention fiirther relates to an image processing ^aratus, comprising: 

- receiving means for receiving a signal corresponding to a series of 

5 consecutive video fields; 

- such a motion sequence pattern detector; and 

- an image processing unit for computing a sequence of output images on basis 

of the series of consecutive video fields, the image processing unit being controUed by the 

motion sequence pattern detector. 
IQ The invention further relates to a method of detecting presence of fihn 

material in a series of consecutive video fields. 

The invention further relates to a computer program product to be loaded by a 
computer arrangement, comprismg instructions to detect presence of fihn material in a series 
of consecutive video fields. 

15 

When focussing on picture rates, three formats can be distinguished: 

- 50 Hz video: A transmission standard, commonly known as PAL or SECAM 
that comprises 50 interlaced fields per second. Each frame comprises 625 lines of which the 

20 even and odd lines are altematingly transmitted as fields. The 50 Hz video standard is used in 
most countries throughout the world except Japan and North America. 

- 60 Hz video: A transmission standard, commonly known as NTSC that 
comprises 60 (59.94 to be exact) interlaced fields per second. Each fiame comprises 525 lines 
of which the even and odd lines are altematingly transmitted as fields. The 60Hz video 

25 standard is used in Japan and North Aoaerica. 

- 24 Hz fihn: Fihn corresponds to a method of recording moving images on a 
long strip of transparent material. The ficame rate of 24 images per second is a compromise 
between tide abiUty to capture motion and Uie amount of fihn required per time interval. The 
standard is older than the video transmission standards. Attenq)ts were made to ad^t the 
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frame rate to 25 and 30 images per second, in order to become more c<mq>atible with 
transmission standards. Except for some exceptions, e.g. commercials, these frame rates did 
not find major much support in the motion picture industry. Therefore. 24 Hz film remains 
the most commonly used standard for motion pictures. 

When television became a popular medium, the need for new content 
increased. This called for format conversion methods. Besides converting motion pictures to 
television, television shows were exchanged between different transmission standards. This 
content also needed conversion. Later, when the television was dominant, video material was 
converted to fihn, e.g. to show television commercials in cinemas. Because of both artistic 
and economic reasons, the motion picture industry still ^lies the same procedure to transfer 

the film format to the video formats. 

The process to transfer fihn to video is called the teledne process. One of the 
many implementations of this process is to iUuminate the fihn and c^ture Ught commg 
through the fihn with a video camera and advancing the fihn m the vertical blankmg period 
1 5 of Ihe video signal. To change the frame rate from 24 Hz fihn to 50 Hz video or 60 Hz video, 
aprocess called "pull-down" is used. Pull-down is a method where the previous picture of the 
fihn is repeated until a new one is available. This method can easily be implemented 
mechamcaUy. To transfer 24 Hz fihn to 50 Hz video, the picture rate of Ihe fihn is increased 
to 25 pictures per second by rmmmg the film shghtly faster. The four percent increase of 
20 speed and pitch of the sound is not regarded as amioymg by the general public. Then, each 
fihnpicture is scanned twice, creating two video fields. This method is called 2:2 pull-down. 
See also Fig IB. To transfer 24 Hz fihn to 60 Hz video, speed up to 30 Hz is not desired, 
shxce Ihe speed up and the change m pitch of the sound is regarded as unacceptable by Ihe 
general pubUc. Therefore another method is used, where every even fihn picture is repeated 
25 three tunes while every odd fihn picture is repeated two times. This creates an hicrease of 
frame rate by a factor 2.5, resulting m a 60 Hz video signal. This mefhod is called 3:2 pull 

down. See also Fig. IC. 

An hnage processmg apparatus, like a TV, might comprise an image 
piocessmg unit for computing from a series of original h^ut hnages a larger series of output 
30 hnages. In that case, a number of the output hnages are temporally located between 
successive original inpvA hnages. This computmg is typically known as hnage rate 
conversion. For hnage rate conversion it is relevant to determme the typeofihe acquisition 

source of the received hnages. That means tibat for adiievmg a good hnage quality, it has to 
be detected whether the received hnages origmate from a fihn camera which acquhred hnages 
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in a progressive scan mode at a lower image rate or originate from a video camera which 
acqxiired images at the image rate of the video signal. Based on that detection, the received 
video fields are combined to form images. In the case that the received video fields 
correspond to film then two successive fields can be merged relatively easily. In the case that 
the received video fields correspond to video then an interpolation of pixels values of the 
video fields is required which is controlled by the detected motion in the images. Incorrect 
handling of a video mode signal as film mode can cause severe artifacts which are clearly 
visible in the output images. These artifacts are known as 'forks*', "mouse teeth", "comb 
efifectf* or "zippers". False video mode detection is less severe, but also yields artifacts. 

hi general, the signal as received by the image processing apparatus does not 
comprise an exphcit indication of the type of acquisition source of the succession of tiie 
video fields. As a result, this information has to be extracted fi-om the video fields 
themselves. Typically this is done by means of detecting a motion sequence patter^ 

An embodiment of the motion sequence pattern detector of the kind described 
in the opening paragraph is known firom US jpatent US 4,982,280. This patent specification 
discloses a motion sequence pattern detector being arranged to detect a periodic pattern of 
motion sequences within a succession of video fields, such as film mode or progressive scan 
mode. The motion sequence pattern detector comprises a motion detector for detecting the 
presence of motion from increment to increment within predetermined increments of the 
succession of video fields and for thereupon outputting a first motion detection signal for 
each said incremCTit The motion detector computes differences between pixel values of 
successive video fields and compares the computation results with a threshold to reduce the 
effect of noise. The motion sequence pattern detector ftirther comprises logic cuxjuitry 
responsive to tiie first motion detection signal for detecting the periodic pattern of motion 
sequences within the succession of video fields. 

Nowadays it is &shionable to have banners, i.e. scrolling texts, and otiier 
information superimposed on video data origination from an other source. In g^eral, these 
scrolling texts are in video mode. The video data upon which they are superimposed, can be 
in film mode. The result is a sequence of video fields that contains both objects or regions in 
film mode and objects in video mode (See Fig. 5). This kmd of sequences are called hybrid 
sequences. 
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Besides this mixing or siq>erimposing, some compression algorithms are 
arranged to encode parts of the sequence in such a mamier, that 2:2 pull-down is introduced. 
An example of such a compression algorithms is DV (Digital Video) coding. In DV coding, 
parts of the image are encoded on frame basis, while other parts are encoded on field basis. 
5 This is to increase coding efiSciency. Coding arti&cts may cause motion patterns similar to 
hybrid signals. 

Most available film detectors are not designed to deal with hybrid sequences, 
since they are arranged to classify sequences as either film mode or as video mode. E.g. for 
frame-rate conversion, this classification does not suffice. So, such detectors are imreliable 
10 on hybrid signals. If a hybrid sequence is detected as fikn mode, annoying artifacts are 
introduced by the frame-rate conversion in the regions that are in video mode. 



In patent application US2002/0131499 a hybrid detector is disclosed. This 
1 5 detector works as follows. Prior to detecting a film mode, the fields of the television signal 
are separated into different objects by means of a segmentation technique. Any known 
technique to do so might be used for that purpose. Then, the fihn mode of each individual 
object is detected. Any known film mode detection technique might be used for that purpose. 
In this context, an "object** may be a portion of an individual image in a field. An "objecf is 
20 defined as an image portion that can be described with a single motion model. Such an 

"object" need not necessarily comprise one ^'physical" object, like a picture of one person. 
An object may well relate to more than one physical object, e.g., a person sitting on a bike 
where the movement of the person and the bike, essentially, can be described with the same 
motion model. On the other hand, one can safely assume that objects identified in this way 
25 belong to one single image originating from one single film source. 

A disadvantage of the known hybrid detector is that a separate segmentation 
step is required. The more so, since robust segmentation is in general relatively complex. 



30 It is an object of the invention to provide a motion sequence pattern detector of 

the kind described in the opening paragraph which is arranged to deal with h3/brid sequences 
and which is relatively simple. 

Tins object of the invention is achieved in that the motion sequence pattern 
detector con:q3rises processing means which is arranged: 
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- to compute for a fibrst one of tiie consecutive fields a value of a video motion 
measure and a value of a film motion measure; and 

to determine the presence of film material on basis of fixe value of the video 
motion measure and the value of the film motion measure, 
the value of the video motion measure being conq)Uted by. 

_ establishmg apluraHty of motion patterns for respective groups of pixels of 

die first one of the consecutive fields; 

- comparing each of the plurality of motion patterns with a predetermined 
video motion pattern and conditionaUy increasing the value of flie video motion measure, 
the value of the film motion measure being computed by: 

- comparing each of tiie pluraHty of motion patterns with a predetermined film 
motion pattem and conditionally increasing the value of the film motion measure. 

Instead of segmenting the field into objects with semantic meaning, a plurality 
of groxq)s of pixels are created, e.g. by means of sub-sampling. The number of these groups is. 
in the order of tiie number of pixels in a field, e.g. 10% or 50% of the total number of pixels 
in the field. Preferably tiie groups of pfacels each have one pixel only. For each of tiiese 
groups of pixels a motion pattem is established and two pattem matches are performed. The 
processing means is arranged to check whether tiie established motion pattem corresponds 
witii a typical video pattem or wheflier tiie established motion pattem corresponds witii a 
typical fihnpattem. After tiiese checks, for tiie corresponding group of pixels tiie probable 
mode, i.e. fihn mode or video mode, for tiiat group of pixels is known. By counting for tiie 
first one of tiie consecutive fields tiie number of times it is decided tiiat a group of pixels has 
a film mo de tiie film motion measure for tiiat field is determined. By counting for tiie first 
one of tiie consecutive fields tiie number of times it is decided tiiat a group of pixels has a 
video mode, the video motion measure for tiiat field is detecmmed. The eventiial 
classification is made based on tiie ratio between and values of tiie video motion measure and 

the film motion measure: 

- the value of tiie film motion measure is relatively Hgh and tiie value of ttie 
video motion measure is relatively low. So, tiie field primarily comprises material originating 
fiom a film camera, ie. tiie field corresponds to fihn mode; 

- tiie value of tiie video motion measure is relatively high and tiie value of tiie 
fihn motion measure is relatively low. So. tiie fieldprimarily comprises material origmating 
fiom an interlaced video camera, i.e. tiie field corresponds to video mode; 
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- the value of the video motion measure and the value of the film motion are 
comparable. So, the field comprises mataial originating from an interlaced video camera but 
also material originating firom a film camera , i.e. the field corresponds to a hybrid mode. 

- the value of the video motion measure is relatively low and the value of the 
film motion measure is relatively low. No significant motion has been detected, i.e. the field 
corresponds to a static mode. 

In an embodiment of the motion sequence pattern detector according to the 
invention the processing means are arranged to establish a first one of the motion patterns by 
coiiq>uting: 

- a first diffCTence between a first pixel value of the first one of the consecutive 
fields and a second value being derived fix>m a second one of the consecutive fields; and 

- a second difference between a third pixel value of a third one of the 
consecutive fields and a fourth value being derived firom the second one of the consecutive 
fields. 

Hence, the motion pattern comprises two diffrarences between values derived fl-om 
subsequent fields. The computation of such a pattern is relatively easy and requires relatively 
little compuiing resource usage. Preferably the two differences are compared with thresholds 
to distinguish motion &om noise. That means that the processing means are arranged to 
establish a motion pattern by comparing the first difference with a fiorst predetermined motion 
threshold and the second difference with a s«x)nd predetermined motion threshold. 
Typically, the first predetermined motion threshold and the second predetermined motion 
threshold are mutually equal. Optionally, the second value and the fourth value are mutually 
equal. Preferably, the second value is also based on a pixel value of another fields, e.g. the 
first one of the consecutive fields. Preferably, the fourth value is also based on a pixel value 
of another field, e.g. the third one of the consecutive fields. 

In an embodiment of the motion sequence pattern detector according to the 
invention the processing means are arranged to increase the value of the video motion 
measure if the first difference is larger than the first predetermined motion threshold and the 
second diffecence is larger than tiie second predetermined motion threshold. In the case that 
the motion pattern comprises two relatively hi^ values it is assumed that the motion pattern 
corresponds to video mode. As a consequence the value of the video motion measure has to 
be increased. 

In an embodiment of the motion sequence pattern detector according to the 
invention the processing means are arranged to modify the value of the fihn motion measure 



10 
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if only the fest difference is larger than the first predetennined motion threshold or only the 
second difference is larger thanflxesecondi«:edetermh^ 

themotionpattem comprises one relatively hi^ value and onerelatively low value it IS 
assumedthatthemotionpattemcorrespondstofihnmode.Asaconsequence1heval^ 

fihn motion measure has to be increased. 

In an embodiment of the motion sequence pattern detector according to the 
inventiontheprocessingmeansarearrangedtoestabUd.afirstoneofthemotionpatten^ 

- computing a third difference between the first pixel value of the first one of 

the consecutive fields andihe thirdpixel value of the third one of the consecutive fields; 

- computing a first minimum of the first di^renoe and the third difference and 

assigning the first minimum to the first difference; and 

- computing a second minimum of the second difference and the tiiird 

difference and assigning the second minimum to the second difference. 
An advantage of tins embodim«rt is that it is arranged to correctly deal with vertical detail, 
eg stmcturesintixeimagewhichhaveaverticalsizesubstantiallyequaltothesizeofone 

video lme.Tlxese structures wMc^arepresent in e.g.ti.e odd fields andnot in the ev^ 

mightbemt«pretedasmotion.Toovercometinsmisuxterpretationthecomparis^ 

third difference is made. 

An embodiment of the motion sequence pattern detector according to the 
inventionisarrangedtooutputasignalindicatingpresenceoffihnmaterialatalocation^ 

corresponding to a first one of the groups of pixels onbasis of con^aring a first one of the 
motionpattems. with the predetermined fihnmotionpattem, the first one ofthe motion 

pattemscorrespondmgtothefirstoneofthegroupsofpixels.^eadofprovidmga 

classification value(fihn,video,hybridorstatic)for the field, more detailedinformatio^ 

provided. e.g. a kind ofmask which represents which portions of the image correspond to 

fihn mode and which portions correspond to video mode. 

An embodiment of tiie motion sequence pattern detector accordmg to tiie 
imrentioncomprisesacontrastmeasurementunitforselectingafirstoneofti^^ 

pixels by means ofi ^ . , eth^ 

30 - computing a first value of a contrast measure fi>r a first set of p«els of flie 

first one ofihe consecutive fields; 

- comparing tiie first value of tiie contrast measure witii a predetetmmed 

contrast threshold; and 



20 
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- assigning the first set of pixels as the jSrst one of the groups of pixel if the 
first value of the contrast measure is higher than the predetermined contrast threshold. 
By selecting pixels or groups of pixels with a relatively high amount of contrast the noise 
sensitivity is reduced. In other words, an advantage of this motion sequence pattern detector 

5 is that it is more robust. 

In an embodiment of the motion sequence pattern detector according to the 
invention, the contrast measurement unit is arranged to compute the first value of the contrast 
measure on basis of calculating a first difference between the value of a first one of the pixels 
of tihte first set of pixels and the value of another pixel of the first one of the consecutive 
10 fields. This embodiment is arranged to compute spatial contrast. 

In an embodiment of the motion sequence pattern detector according to the 
invention, the contrast measurement unit is arranged to compute the first value of the contrast 
measxire on basis of calculating a second difference between the value of the first one of the 
pixels of the fii^t set of pixels and the value of a further pixel of a second one of the 
15 consecutive fields. This embodiment is arranged to compute spatio-temporal contrast. 

An embodiment of the motion sequence pattern detector according to the 
invention is arranged to compute a new predetermined contrast threshold on basis of the 
number of times the values of the contrast measure being computed for tiie first one of the 
consecutive fields have exceeded the predetermined contrast threshold. In other words, the 
20 value of the contrast threshold is dynamically adapted. As a consequence the nmnber of 
groups of pixels which is used for the motion pattern matching is relatively constant over 
time. An advantage of this embodiment according to flie invention is that the number of 
corrq)utations is relatively constant. 

It is another object of the invention to provide an image processing apparatus 
25 of the kind described in the opening paragraph which comprises a motion sequence pattern 
detector which is arranged to deal with hybrid sequences and which is relatively simple. 

Hiis object of the invention is achieved in that the motion sequence pattern 
detector of the image processing apparatus, comprises processing means which is arranged: 

- to compute for a first one of the consecutive fields a value of a video motion 
30 measm:e and a value of a film motion measure; and 

- to determine the presence of film material on basis of the value of the video 
motion measure and the value of the film motion measure, 

the value of the video motion measure being computed by: 



10 
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- establishing apluraUty of motion patterns for respective groups of pixels of 

the first one of the consecutive fields; 

- comparing each of the pluraUty of motion pattans with a predetermined 
video motionpattem and conditionally increasing the value of the video motionmeasure, the 
value of the fihn motion measure being computed by. 

- comparing each of the pluraHty of motion patterns with a predeteraiined fihn 
motion pattern and conditionally increasing the value of the fihn motion measure. 

The image processing unit of the image processing ^paratus might support 
one or more of the following types of image processhag: 

- Video compression, i.e. encoding or decodmg. e.g. according to the MPEG 

standard. 

- De-interlacing: Interlacing is the common video broadcast procedure for 
transmitting the odd or even numbered image lines alternately. De-interlacing attempts to 
restore the fhll vertical resolution. i.e. make odd and even lines available simultaneously for 

15 each image; 

- Image rate conversion: From a series of original iapnt images a larger senes 
of oulput images is calculated. Oulput images are temporally locatedbetween two original 
input ima^; and 

- Temporal noise reduction. This can also involve spatial processing, resulting 

20 in spatial-temporal noise reduction. 

The image processing apparatus optionally comprises a display device for 
displaymg the output images. The image processing apparatus optionally comprises storage 
means for storage of images: either the input or the output images. The image processmg 
apparatus might e.g. be a TV, a set top box, a VCR (Video Cassette Recorder) player, a 
25 satelUte tuner, or aDVD (Digital Versatile Disk) player or recorder. 

It is anoflier object of tiie invention to provide a method of tiie kind described 
in tiie opening paragr^h which can deal witii hybrid sequences and which is relatively 
simple. 

This object of tiie invention is achieved m tiiat tiie metiiod of detecting 
30 presence of fihn material m a series of consecutive video fields, comprises: 

- computing fijr a first one of tiie consecutive fields a value of a video motion 
measure and avalue of a fihn motion measure; and 
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- determining the presence of film material on basis of the value of the video 
motion measure and the value of the film motion measure, the value of the video motion 
measure being computed by: 

- establishing a plurality of motion patterns for respective groups of pixels of 
S the first one of the consecutive fields; 

- comparing each of the plurality of motion p atterns with a predetermined 
video motion pattem and conditionally increasing the value of the video motion measure, the 
value of the fihn motion measure being computed by: 

- comparing each of the plurality of motion patterns with a predetermined film 
1 0 motion pattem and conditionally increasing the value of the film motion measure. 

It is another object of the invention to provide a computer program product of 
the kind described in the opening paragraph which can deal with hybrid sequences and which 
is relatively simple. 

This object of the invention is achieved in that the computer program product 
1 5 after being loaded, providing said processing means with the capability to carry out the 
followmg steps: 

- computing for a first one of the consecutive fields a value of a video motion 
measure and a value of a film motion measure; and 

- determining the presence of film material on basis of the value of the video 
20 motion measure and the value of the film motion measure, the value of the video motion 

measure being computed by: 

- establishing a plurality of motion patterns for respective groups of pixels of 
the first one of the consecutive fields; 

- comparing each of the plurality of motion patterns with a predetermined 

25 video motion pattem and conditionally increasing the value of the video motion measure, the 
value of the film motion measure being computed by: 

- comparing each of the plurality of motion patterns with a predetermined film 
motion pattem and conditionally increasing the value of the film motion measure. 
Modifications of the motion sequence pattem detector and variations thereof may correspond 

30 to modifications and variations thereof of the method, of the computer program product and 
of the image processing apparatus described. 
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These and other aspects of the motion sequence pattern detector, of the 
melhod, of the conq>uter program product and of the image processing apparatus according to 
the invention wiU become apparent ftom and wiU be elucidated with respect to the 

implementations and embodiments described hereinafter and with reference to the 

accompanying drawings, wherein: 

Fig. lA schematically shows two fields of one ftame; 

Fig. IB schematicaUy shows 2:2 pull-dowl^ 

Fig. IC schematically shows 3:2 pull-down; 

Fig. 2 schematically shows three consecutive video fields; 

Fig. 3 A schematicaUy shows an embodiment of the motion sequence pattern 

detector according to the invention; 

Fig. 3B schematically shows an embodiment of the motion sequence pattern 
detector according to the invention, comprising a contrast measurement unit; 

Fig. 4 schematically shows a two-dimensional feature space; 
Fig. 5 schematically shows a two-dimensional mask indicating the type of 

Fig. 6 schematically shows an embodiment of the image processing apparatus 
according to the invention. 

Same reference numerals are used to d«K.te sfamte parts teoughoat the figs.. 

Kg lA schemalioally shows two successive fields 100. 102 of a video signal 
Ike first field 100 coniprises the pixel values, e,g. 104-1 12 of the odd lines of «.e fi«ae md 
a» s«=ond field 102 eon^ses the pixel values, e.g. 114-122 of tl» even lines of flte ftanu. 
F« instance at ftame coordinates corresponding to pixel 1 16 of the second field 102 ti«.e « 
no rixd vata. 124 directly available in the first field 100. That means that if a p«el value 
124 is tequi«da«ttopixelvaluehastobe derived firom other pixel values.Parexanvle, 
tU. mxdl vatae is d«ived, Le. can be cdodated by means of an inteqK>ladon of pixel values 

of fl» first field 100, e.g. by means of an intetpolatton based on the pixel values 104-109. 
OpaonaUylessptael value, arc takminto account An intepolafionmight also include an 

orfer staBsacal operation suA as a medi«r op^atton. B may also iiKtade pixels ftom field 
102 or ftom a (not depicted field preceding field 100. 

Hg iBs<*«naticaUyahows2apttU^wn.Aninratstieamofplct>itesU0- 

136 vrilh a ftequency of 25 HZ is up-comretted t» o. ou*»l stream of video fields 138-152 



mode; and 



25 
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with a ftequency of 50 Hz, The different phases {O,l}of the video fields are denoted below 
the video fields 138-152. This film phase indicates the position in the repetition pattern and is 
typically calculated in a film detector. 

Fig. IC schematically shows 3:2 piiU-down. An input stream of pictures 160- 
5 164 with a frequency of 24 Hz is iq>-converted to an output stream of video fields 168-182 
with a jfrequency of 60 Hz. The different phases {0,1 A3»4}of the video fields are denoted 
below the video fields 168-182. 

Fig. 2 schematically shows a number of pixels 202-222 of three consecutive 
video fields: current c, previous p and pre-previoxis pp. The current field corresponds with n , 
10 the previous field corresponds with n-1 and the pre-previous corresponds with n-2. The 
current field c and the pre-previous field pp comprise even lines and the previous field p 

comprises odd lines. In this document, a pixel value of a pixel is denoted with a three- 

— «- — ► 
dimensional luminance fimction F(x,n) , with the vector x comprising two spatial 

coordinates x and y . The pixels 202-208 of the pre-previous field pp correspond to pixels of 
15 a column with a certain x -coordinate which is equal to the x -coordinate of the column to 
which the pixels 210-214 of the previous field p belong and equal to the x -coordinate of the 
column to which the pixels 216-222 of the current field c belong. For some of the pixels the 
coordinates are depicted. E.g. pixel 204 has coordinates {x^y»n - 2) and pixel 210 has 
coordinates (jc,j;-l,w-l). 
20 As explained in connection with Fig. 1 A it is possible to determine pixel 

values for pixels for which there is no pixel value directly available. E.g. the value for a pixel 
with coordinates (jc, y,n—V) might be determined by means of pixel values in the spatio- 
temporal CTLvironment of (x, y^n-1). 

Fig. 3 A schematically shows an embodiment of the motion sequence pattern 
25 detector 300 according to the invention, comprising: 

- a number of input connections for providing the motion sequence pattern 
detector 300 with luminance values of respective pixels; 

- a number of de-interlacing units 302 and 304; 

- a number of subtraction units 306-3 10 for calculating the absolute difference 
30 between two incoming values; 

- a nuniber of minimum operators 312 and 314 for detemuning Ihe mminmm 
of two incoming values; 
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- anumber of comparators 316 and 318 for detecting whether an incoming 
value is higher than a predetermined threshold; 

- a logical unit 320 comprising a number of inverters and and-operators; 

- a number of counters 322- 326; 

- a combining unit 328 for combining the results of the counters 322-326; 

- a number of output connectors 330 and 332; 

- a control interface 334 for resetting tiie values of the counters 322-326 after 
the conq>utations for a field have been completed; and 

- anmnber of control interface 336 and 338 for adapting the values of the first 

predetemiined motion ihreshold and the second predetermined motion threshold Tj;. 

The motion sequence pattern detector 300 may be implemented using one processor. 

Normally, these functions are performed under control of a software program product. 

During execution, normaUy Ihe software program product is loaded into a memory, like a 
RAM. and executed ftom there. The program may be loaded from a background memory, 
like a ROM, hard disk, or magnetically and/or optical storage, or may be loaded via a 
network like Mtemet. Optionally an appUcation specific integrated circuit provides the 

disclosed functionality. 

The working of the motion sequence pattern detector is as follows. 

Suppose that for aparticularpixel 218 with coordinates (x.y.n) the mode has 

to be determined. The motion sequence pattern detector 300 is provided with anumber of 
pixel values. Alternatively the motion sequence pattern detector 300 is arranged to access a 
memory device 342 to retrieve these pixel values. This embodiment requires the followmg 
pixel values Fi.,y,n),Fix,y,n-2), F(x,y-l,n-l) and Fix,y^l,n-1) inorderto 
determine the mode for pixel 218 with coordinates (x, y,n) . (See also Fig. 2) 

On basis of three of these pixel values a first estimate Fiix,y,n-l)is 
computed for the pixel with coordinates (x. 3., n - 1) . Ibis is done by the first de-intodadng 
unit 304. m this case tixe de-interlacing is based on a median operation as specified in 
Equation 1. 

F,(x.y,n-1) =M«iia«(F(x.y-l,/i-l).F(x,:>;+l.n-l),F(x.j^.«-2)) (1) 
) Alternatively otiier types of de-interlacing can be appUed, e.g. onbasis of an 

averagiiig operation. 
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On basis of three of the input pixel values also a second estimate 
(jc, 7, n - 1) is confuted for the pixel with coordinates (x, This is done by the 
second de-interlacing unit 302. In this case the de-interladng is based on a median operation 
as specified in Equation 2: 
5 (jc, J/, « - 1) = Median(Fix, y--l,n-V), F{x, y^l,n-l\ F{x, n)) (2) 

The next step comprises computing: 

- a first difference (jc, y) between a first pixel value F^x^y^n - 2) of the 

first one of the consecutive fields pp and the first estimate (x, « -1) being derived firom a 
second one of the consecutive fields p, as specified in Equation 3; and 
10 - a second difference {x, y) between a third pixel value y, n) of a third 

one of the consecutive fields c and the second estimate F^ (x, y,n-l) being derived from the 
second one of the consecutive fields p, as specified in Equation 4. 

S^ix,y)=^\Fix,y,n-2)-F,ix,y,n-l)\ (3) 

S,ix,y) = \Fix,y,n) -F^ix,y,n^l)\ (4) 

15 The next step comprises: 

- computing a third difference Sj- {x,y) between the first pixel value 

F(x, y.n-l) of the first one of the consecutive fields pp and the third pixel value 
F(x,y,n) of the third one of the consecutive fields c, as specified in Equation 5; 

- computing a first minimum Sp{x,y) of the first difference Sp(x,y) and the 
20 third difference Sj^ (x^ y) and assigning the first minimum to the first difference, as specified 

in Equiation 6; and 

-computing a second minimum <y^(;c,7)of the second differeace S^(x,y)BXxd 
the third difference S. (x, y) and assigning the second mi n imuni to flie second difference, as 



specified in Equation 7. 

25 Sf(x,y) = \F(x,y,n-2)-F(x,y,n)\ (5) 

^r;(x,y) = nun(iy^(x,j^),^y.(x,y)) (6) 

Slix,y)^nMS,ix,y%S^ix,yy) (7) 
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The next step conqoises comparing Hie first dij^rence S\ (jc, y) wifli a first 
predeteimined motion threshold Tl and the second difference S\{x,y) with a second 
predetermined motion threshold J^. This is done by means of comparators 318 and 316, 
respectively. The comparator 318 provides Boolean valuesM,(x,:);) as output, which indicate 
5 whether there is movement between tiie first derived pixel with coordinates (x, y,« -1) and 
the pixel 204 with coordinates {x,y, n - 2) . The comparator 316 provides Boolean values 

(x, y) as output, which indicate whether there is movement between the particular pixel 
218 with coordinates ix^y^rC^ and the second derived pixel with coordinates (x,y,n-l).The 
iBput-output relation of conq)arator 318 is specified in Equation 8 and the input-ou^ut 
10 relation of comparator 316 is specified in Equation 9: 

If 5\ (;c, 7) > then M/x, = 1 else (x, y) = 0 (8) 
If S],(x,y) > n then M,{x,y) = 1 else M,(x.y) = 0 (9) 
Table 1 shows the four different possible combinations of the values of 
MXx,y) and M^Cx,;;). These combhiations correspond to possible motion patterns 1-4. For 

15 each of these patterns Table 1 indicates whether the motion pattern is a predetermined video 
motion pattern or one of the predetermined fihn motion patterns. 



Pattern 
identification 


Mp{x,y) 


M,{x,y) 


Type of motion pattern 


1 


0 


0 


No movement, type unknown 


2 


0 


1 


Film motion pattern, phase A 


3 


1 


0 


Film motion pattern, phase B 


4 


1 


1 


Video motion pattern 



20 



Hence, onbasisof the values of and Af, the mode fi>r the 

particular pixel 218 is determined. 

The mode is determmed for a large number N of pixels of each field, e.g. for 
25% of tiie pixels of a field. The pixels might be selected on basis of a simple sub-sampling 
strategy. The results of the mode determinations are accumulated by means of a number of 



PHNL021250EPP 



16 11.122002 

coimters 322- 326. Each time a pattesm with identification 2 is detected then the value of 5 ^ 
is increased with 1, as specified in Equation 10: 

5^ = I = 0 aM,(^,:v) = 1} (10) 

Each time apattem with identification 3 is detected then the value of S%„ is increased wiih 

5 1, as specified in Equation 1 1 : 

S%n =Y.^\M^(x,y) = \A.MSx,y)^0} (11) 

N 

Each time a pattern with identification 4 is detected then the value ofS^ is increased with 
1, as specified in Equation 12: 

N 

10 Eventually the values , S,,,^ and S%„ of the counters 322-326 are 

combined by means of combining unit 328. One of the operations being performed by the 
combining unit 328 is specified in Equation 13. The reason for the subtraction of the •'min"- 
tenn is to eliminate the effect of covering and uncovering. This subtraction is optionally. 

5^ =1^^ -5j^|-min(5t,5'^) (13) 

1 5 Finally a vector 5 comprising two values is achieved as denoted in Equation 14: 

This vector 5 can be used to detect the mode using a set of thresholds as depicted m Fig. 4. 
The mode is provided at flie output connector 330. Optionally, the vector S is provided at the 
output connector 330. Optionally a two-dimensional mask indicating the type of mode per 

20 pixel or group of pixels is provided at the output connector 332. (See Fig. 5) 

Fig. 3B schematically shows an embodiment of the motion sequeuce pattern 
detector 301 according to the invention, conq)rising a contrast measurement unit 340. The 
contrast measuremrait unit 340 is arranged to make a selection of groups of pixels on basis of 
the pixel values of the video fields. More particular on basis of differences between pixel 

25 values. 

Suppose that each of the groups of pixels contain one respective pixeL 
Decidmg whether a particular pixel is to be selected for the motion pattern detection, 
comprises the following steps: 

- computing the value of a contrast measureC' ix,y,n) for the particular pixel; 



10 



PHNL021250EPP 

17 11.12.2002 
-comparing the value ofthe contrast measure C>(x,j;.n) with a predetermined 

contrast tiiteshold T^(j%) ; and 

- assigning the particular pixel as the first one of the groups of pixel if the 
value offlie contrast measure C' (;c.y.«) is higher than the predetermined contrast toshold 

r,(«). 

Bytestingalarge number ofpixelsofavideo field witti coordinate nacollection 5(n)of 
groups of pixels is created for that field. The coUection 5(n)is q)ecified by means of 
Equation 15: 

Bin) = {(x,y) I VC' (,x,y,n) > TSn)} 

For calculating a contrast measure C (jc, y, ») spatial or temporal pixels, 
related to {x, n) , can be applied. Optionally, multiple comparisons are made. This will be 

e3q)lained by means of some example. 

Si5>pose that the value of a first contrast measure C (x,y,n) is computed on . 
basis of calculating a first difference between the value ofthe particular pixel and the value 
15 of another pixel of Uie same field, as specified if Equation 16 : 

C'(x,y,n) = Fix,y,n)-Fix,y~2,n) (16) 
Suppose that the value ofasecondcontrastmeasure C^(x.>;,n) is computed 
on basis of calculating a second difference between the value of the particular pixel and the 
value of a further pixel ofthe same field, as specified if Equation 17: 

C\x,y,n) = Fix,y,n)-Fix-l,y,n) 0*7) 
Suppose that the value ofathirdcontrastmeasure C\x,y,n) is computed on 
basis of calculating a third difference between the value of the particular pixel and the value 
of a pixel of Uie another field, as specified if Equation 18: 

C\x,y,n) = Fix,y,n)-F{x,y»n-2) (18) 
25 Equation 15 can be rewritten into Equation 19: 

5(n)»{(*,:>')|V(c»(*.y,«)>2;(»)AC^(x,:»',«)>2;(«)AC'(x.3;.«)>r,(n))} (i9) 

It will be clear tiiat alternative ^proaches can be ^pUed to estimate local 
contrast. i.e. to calculate a contrast measure C'ix,y,n) . Only those pixels whichhave a 
relatively high contrast compared to their spatio-temporal enviromnent are selected for the 
30 motion pattern detection. 



20 
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Preferably the value of the contrast threshold T, (n) is dynamically ad^ted. 
E.g. if the actual selected groups of pixels for a particular field is higher than a target value, 
then the value of Ihe contrast threshold (n + 1) for the next field is based on an increased 
value of (n) . If the actual selected groups of pixels for aparticular field is lower than a 

5 target value, then the value of the contrast threshold T^(n+1) for the next field is based on a 
decreased value of T„in) . The target value might be equal to 20% of the total number of 
pixels of flie field. As a consequence the number of groups of pixels being used per field for 
the motion pattern matching is relatively constant over time. An advantage of this 
embodiment according to the invention is fliat Ihe number of conq>utations is relatively 

10 constant 

Optionally the values of the first predetermined motion threshold and the 
second predetermined motion threshold depend on the value of the contrast threshold 
(n) , e.g. as spedfied in Equations 20 and 21 : 

rj'W^o.sr.Cn) (20) 
15 r;(n) = o.5r„(») (21) 

This means that the motion thresholds are high for fields with high contrast, so the motion 
sequence pattern detector becomes relatively insensitive to noise without loss of motion 
sensitivity. So, an advantage of this embodiment is gracefiil degradation, smce the trade off 
between noise sensitivity and motion sensitivity is automaticaUy adapted to the contrast in 

20 the video signal. 

Fig. 4 schematically shows a two-dimensional feature space. The x-axis 402 

corresponds with the parameter S^^ as specified in Equation 13. The y-axis 404 corresponds 
with the parameter as specified in Equation 12. Note that the two axes arc normalized to 
the total number of pfacels used to classify the motion pattern. That means that a location in 
25 the two-dimaosional feature space corresponds with the vector 5 = (5^ , S^^^ ) . The two- 
dimensional feature space is divided into a number of regions by means of a number of 
boundaries 406-410. Bach of the regions corresponds with a certain mode. In other words, 
based on the computed 5 = (5r^,5^^^) and the rules for classification as schemafically 
provided by means of Fig. 4 the eventual mode for a particular field can be determined: 
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- 1: The field primarily comprises material origjnating from an interlaced video 
paTnem and hence the field corresponds to video mode; 

- H: The field primarily comprises material originating from a film camera and 
hence ibe field corresponds to film mode; 

- ni: The field comprises material originating &om. an interlaced video camera 
but also material originating from a film camera and haice the field corresponds to a hybrid 
mode; 

- IV: No significant motion has been detected and hence the field corresponds 
to a static mode. 

Fig. 5 schematically shows a two-dimensional mask 500 indicating liie types 
of mode of a field of a hybrid sequence. Most of the field 504 comprises material which 
originates from a film camera and only a relatively small portion 502 corresponds to video 
material. A mask as depicted in Fig. 5 is an output of the motion sequence pattern detector 
300 and is provided at the output connector 332. 

Fig. 6 schematically shows an embodiment of the image processing ^paratus 
600 according to the invention, comprising: 

- Receiving means 602 for receiving a signal representing input images 
comprismg video fields. The signal may be a broadcast signal received via an antemm or 
cable but may also be a signal from a storage device like a VCR (Video Cassette Recorder) 
or Digital Versatile Disk (DVD). The signal is provided at the input connector 610; 

- The motion sequence pattern detector 608 as described in connection with 

any of the Figs 3A or 3B; 

- An image processing unit 604 for calculating a sequence of output images on 
basis of the succession of video fields. The image processing unit 604 is controlled by the 
motion sequence pattern detector 608. Control means that the output of the motion sequence 
pattern detector 608 influences the image processing unit 604. For mstance, if the image 
processing unit 604 is arranged to perform de-interlacing then the output (mode and phase) is 
used to combine corresponding video fields to images; and 

- A display device 606 for displaying the ou^ut images of the image 
processing unit 604. This display device 606 is optional. 

The image processing apparatus 600 might e.g. be a TV. Alternatively the image processing 
i^aratas 600 does not comprise the optional display device 606 but provides the oulput 
images to an ^aratus that does comprise a display device 606. Then the image processing 
^aratus 600 might be e.g. a set top box, a sateUite-tuner, a VCRplayw, aDVD player or a 
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DVD recorder. Optionally the image processing apparatus 600 comprises storage means, like 
a hard-disk or means for storage on removable media, e.g. optical disks. The image 
processing apparatus 600 might also be a system being ^plied by a film-studio or 
broadcaster. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention and that those skilled in the art will be able to design alternative 
embodunents without departing firom the scope of the upended claims. In tiie claims, any 
reference sigos placed between parentheses shall not be constructed as limiting the claim. 
The word *comprismg* does not exclude the presence of elements or steps not listed in a 
claim. The word "a" or "an" preceding an elCTient does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. 
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^2. 12. 2002 



@ 



1 . A motion sequence pattern detector for detecting pres^ice of film material in a 
series of consecutive video fields, the motion sequence pattern detector comprising 
processing means which is arranged: 

- to compute for a first one of the consecutive fields a value of a video motion 
5 measure and a value of a film motion measure; and 

- to determine tiie presence of film material on basis of the value of the video 
motion measure and the value of the film motion measure, 

the value of the video motion measure being computed by: 

- establishing a plurality of motion patterns for respective groups of pixels of 
10 the first one of the consecutive fields; 

- comparing each of tihe plurality of motion patterns with a predetermined 
video motion pattern and conditionally increasing the value of the video motion measure, 
the value of the fihn motion measure being computed by: 

- comparing each of the plurality of motion patterns with a predetermined film 
1 5 motion pattem and conditionally increasing the value of the fihn motion measure. 

2. A motion sequence pattem detector as claimed in claim 1, wherein the groups 
of pixels each have one pixel. 

20 3. A motion sequence pattem detector as claimed in claim 1, wherein the 

processing means are arranged to estabUsh a first one of the motion patterns by computing: 

- a first difference between a first pixel value of tiie first one of the consecutive 
fields and a second value being derived fiom a second one of the consecutive fields; and 

- a second difference between a third pixel value of a Ifaird one of the 

25 consecutive fields and a fourth value being derived firom the second one of the consecutive 
fields. 

4. A motion sequence pattem detector as claimed in claim 3, wherein the 

processing means are arranged to establish the first one of the motion patterns by comparing 
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the first difierence with a first predetennined motion threshold and the second difference 
with a second predetennined motion threshold. 

5. A motion sequence pattern detector as claimed in claim 4, wherein the 
processing means are arranged to establish a first one of the motion patterns by: 

- compirting a third difference between the first pixel value of the first one of 
Hie consecutive fields and the third pixel value of the third one of the consecutive fields; 

- computing a first minimum of the first difference and the third difference and 
assigning the first minimum to the first difference; and 

- computing a second minimum of flie second differaice and the third 
difference and assigning the second minimum to the second difference. 

6. A motion sequence pattern detector as claimed in claim 4 or 5, wherein the 
piocessmg means are arranged to increase the value of the video motion measure if the first 
difference is larger tiian the first predetermined motion tiireshold and the second difference is 
larger than the second predetermined motion threshold. 

7. A motion sequence pattern detector as claimed in claim 4 or 5, wherein the 
processing means are arranged to modify the value of the fihn motion measure if only tiie 
first difference is larger ttxan the first predetermined motion threshold or only tiie second 
difference is larger tiian the second predetermined motion threshold. 

8. A motion sequence pattern detector as claimed in claim 1, being arranged to 
output a signal indicating presence of fihn material at a location corresponding to a first one 
of the groups of pixels on basis of comparing a first one of tire motion patterns, with tiie 
predetermined film motion pattern, tiie first one of flie motion patterns corresponding to tiie 
first one of the groups of pixels. 

9. A motion sequence pattern detector as claimed in claim 1. comprising a 
contrast measurement unit for selecting a first one of flie groups of pixels by means of: 

- conq>uting a first value of a contrast measure for a first set of pixels of flie 

first one of the consecutive fields; 

- comparing tiie first value of the contiast measure wifli a predetermined 

contrast threshold; and 
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- assigning the first set of pixels as the first one of the grotips of pixel if the 
first value of the contrast measure is higher than the predetermined contrast threshold 

10. A motion sequence pattern detector as claimed in claim 9, wherein the contrast 

measurement \mit is arranged to compute the first value of the contrast measure on basis of 
calculating a first difference between the value of a first one of the pixels of the first set of 
pixels and the value of another pixel of the first one of the consecutive fields. 

1 1 • A motion sequence pattern detector as claimed in claim 10, wherein the 

contrast measuxOTient imit is arranged to compute the first value of the contrast measure on 
basis of calculating a second difference between the value of the first one of the pixels of the 
first set of pixels and the value of a further pixel of a second one of the consecutive fields. 

12. A motion sequence pattern detector as claimed in claim 9, which is arranged to 
compute a new predetermined contrast threshold on basis of the number of times the values 
of the contrast measure being computed for the first one of the consecutive fields have 
exceeded the predetermined contrast threshold. 

13. An image processing apparatus , comprising: 

- receiving means for receiving a signal corresponding to a series of 
consecutive video fields ; 

- a motion sequence pattern detector as claimed in claim 1 ; and 

- an image processing unit for computing a sequence of output images on basis 
of the series of consecutive video fields , the image processing unit being controlled by the 
motion sequence pattern detector. 

14. An image processing apparatus as claimed in claim 13, characterized in fijrfher 
comprising a display device for displaying the output images. 

15. An image processing ^paratus as claimed in claim 14, characterized in that it 
isaTV. 

16. An image processing apparatus as claimed in claim 13, characterized in fiirther 
comprising storage means for storage of the output images. 
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17. An image processing apparatus as claimed in claim 1 6, characterized in that it 
is a DVD recorder. 

1 8. A method of detecting presence of film material in a series of consecutive 

video fields , coinprising: 

- computing for a first one of the consecutive fields a value of a video motion 

measure and a value of a film motion measure; and 

- determining the presence of film material on basis of the value of the video 
motion measure and the value of the fihn motion measure, 

the value of the video motion measure being computed by: 

- estabUshing aplurality of motion patterns for respective groups of pixels of 

the first one of the consecutive fields; 

- comparing each of the plurality of motion patterns with a predetermined 
video motion pattern and conditionally increasing the value of the video motion measure, 
the value of the film motion measure being computed by: 

- comparing each of the plurality of motion patterns with a predetermined fihn 
motion pattern and conditionally increasing the value of the fihn motion measure. 

19. A computer program product to be loaded by a computer arrangement, 

comprising instructions to detect presence of fihn material m a series of consecutive video 
fields , the arrangement comprising processmg means and a memory, the conq)uter program 
product, after being loaded, providmg said processing means with the capability to carry out 

the following steps: 

- computing for a first one of the consecutive fields a value of a video motion 

measure and a value of a fihn motion measure; and 

- determining the presence of fihn material on basis of the value of the video 
motion measure and the value of the fihn motion measure, 

the value of the video motion measure bemg computed by: 

- estabUshmg a plurahty of motion patterns for respective groups of pixels of 

Ae first one of the consecutive fields; 

- comparing each of IhepluraHty of motion patterns with apredetermmed 
video motion pattern and conditionally mcreasmg the value of the video motion measure, 
the value of the film motion measure bemg computed by: 
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- conq)azmg each of the plurality of motion patterns with a predetCTmined fiUm 
motion pattern and conditionally increasing the value of the fihn motion measure. 
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ABSTRACT: 

12. 12. 2002 




A motion sequence pattern detector (300,301) for detecting presaice of film 
material in a series of consecutive video fields (pp,p,c), is arranged to compute for a first one 
of the consecutive fields a value of a video motion measure and a value of a film motion 
measure and to determine the presence of film material on basis of both motion measures. 
The value of the video motion measure is computed by: establishing a plurality of motion 
patterns for respective groups of pixels of the first one of the consecutive fields; comparing 
each of the plurality of motion patterns with a predetermined video motion pattern and 
conditionally increasing the value of the video motion measure. The value of the film motion 
measure is computed by comparing each of the plurality of motion patterns with a 
predetermined fihn motion pattern and conditionally increasing the value of the fihn motion 
measure. 
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